Cross-Modal Interaction Networks for Query-Based Moment Retrieval in Videos

Query-based moment retrieval aims to localize the most relevant moment in an untrimmed video according to the given natural language query. Existing works often only focus on one aspect of this emerging task, such as the query representation learning, video context modeling or multi-modal fusion, thus fail to develop a comprehensive system for further performance improvement. In this paper, we introduce a novel Cross-Modal Interaction Network (CMIN) to consider multiple crucial factors for this challenging task, including (1) the syntactic structure of natural language queries; (2) long-range semantic dependencies in video context and (3) the sufficient cross-modal interaction. Specifically, we devise a syntactic GCN to leverage the syntactic structure of queries for fine-grained representation learning, propose a multi-head self-attention to capture long-range semantic dependencies from video context, and next employ a multi-stage cross-modal interaction to explore the potential relations of video and query contents. The extensive experiments demonstrate the effectiveness of our proposed method.Comment: Accepted by SIGIR 2019 as a full pape

Outcomes of Pregnancy in Women with Congenital Heart Disease: A Single Center Experience in Korea

Pregnancy outcomes in patients with congenital heart disease have not been fully assessed in Korea. Forty-nine pregnancies that occurred in 34 women with congenital heart disease who registered at our hospital between September 1995 and April 2006 were reviewed. Spontaneous abortions occurred in two pregnancies at 6+1 and 7 weeks, and another two underwent elective pregnancy termination. One maternal death in puerperium occurred in a woman with Eisenmenger syndrome. Maternal cardiac complications were noted in 18.4%, pulmonary edema in 16.3%, symptomatic arrhythmia in 6.1%, deterioration of New York Heart Association (NYHA) functional class by ≥2 in 2.0%, and cardiac death in 2.0%. Independent predictors of adverse maternal cardiac events were an NYHA functional class of ≥3 (odds ratio [OR], 20.3), right ventricular dilation (OR, 21.2), and pulmonary hypertension (OR, 21.8). Neonatal complications occurred in 22.4% of pregnancies and included preterm delivery (16.3%), small for gestational age (12.2%), and neonatal death (2.0%). Independent predictors of adverse neonatal events were pulmonary hypertension (OR, 6.8) and NYHA functional class ≥3 (OR, 23.0). Pregnancy in women with congenital heart disease was found to be significantly associated with maternal cardiac and neonatal complications. Pre-pregnancy counseling and multidisciplinary care involving cardiologists and obstetricians are recommended for women with congenital heart disease contemplating pregnancy

The First Very Long Baseline Interferometry Image of 44 GHz Methanol Maser with the KVN and VERA Array (KaVA)

We have carried out the first very long baseline interferometry (VLBI) imaging of 44 GHz class I methanol maser (7_{0}-6_{1}A^{+}) associated with a millimeter core MM2 in a massive star-forming region IRAS 18151-1208 with KaVA (KVN and VERA Array), which is a newly combined array of KVN (Korean VLBI Network) and VERA (VLBI Exploration of Radio Astrometry). We have succeeded in imaging compact maser features with a synthesized beam size of 2.7 milliarcseconds x 1.5 milliarcseconds (mas). These features are detected at a limited number of baselines within the length of shorter than approximately 650 km corresponding to 100 Mlambda in the uv-coverage. The central velocity and the velocity width of the 44 GHz methanol maser are consistent with those of the quiescent gas rather than the outflow traced by the SiO thermal line. The minimum component size among the maser features is ~ 5 mas x 2 mas, which corresponds to the linear size of ~ 15 AU x 6 AU assuming a distance of 3 kpc. The brightness temperatures of these features range from ~ 3.5 x 10^{8} to 1.0 x 10^{10} K, which are higher than estimated lower limit from a previous Very Large Array observation with the highest spatial resolution of ~ 50 mas. The 44 GHz class I methanol maser in IRAS 18151-1208 is found to be associated with the MM2 core, which is thought to be less evolved than another millimeter core MM1 associated with the 6.7 GHz class II methanol maser.Comment: 19 pages, 3 figure

A Case of Osteoclast-like Giant Cell Tumor of the Pancreas with Ductal Adenocarcinoma: Histopathological, Immunohistochemical, Ultrastructural and Molecular Biological Studies

Osteoclast-like giant cell tumor of the pancreas is a very rare neoplasm, of which the histiogenesis remains controversial. A 63-yr-old woman was hospitalized for evaluation of epigastric pain. An abdominal computerized tomography revealed the presence of a large cystic mass, arising from the tail of pancreas. A distal pancreatectomy with splenectomy was performed. Histologically, the tumor was composed of mononuclear stromal cells intermingled with osteclast-like giant cells. In addition, there was a small area of moderately to well differentiated ductal adenocarcinoma. The final pathologic diagnosis was osteoclast-like giant cell tumor of the pancreas with ductal adenocarcinoma. Here, we describe the histopathological, immunohistochemical, ultrastructural and molecular biological findings of this tumor with review of the literature pertaining to this condition

The genome sequence of Xanthomonas oryzae pathovar oryzae KACC10331, the bacterial blight pathogen of rice

The nucleotide sequence was determined for the genome of Xanthomonas oryzae pathovar oryzae (Xoo) KACC10331, a bacterium that causes bacterial blight in rice (Oryza sativa L.). The genome is comprised of a single, 4 941 439 bp, circular chromosome that is G + C rich (63.7%). The genome includes 4637 open reading frames (ORFs) of which 3340 (72.0%) could be assigned putative function. Orthologs for 80% of the predicted Xoo genes were found in the previously reported X.axonopodis pv. citri (Xac) and X.campestris pv. campestris (Xcc) genomes, but 245 genes apparently specific to Xoo were identified. Xoo genes likely to be associated with pathogenesis include eight with similarity to Xanthomonas avirulence (avr) genes, a set of hypersensitive reaction and pathogenicity (hrp) genes, genes for exopolysaccharide production, and genes encoding extracellular plant cell wall-degrading enzymes. The presence of these genes provides insights into the interactions of this pathogen with its gramineous host

Drug Resistance Rates of Mycobacterium tuberculosis at a Private Referral Center in Korea

The goals of this study were to identify first-line drug resistance in new and previously treated tuberculosis (TB) cases and to determine risk factors for multidrug-resistant TB (MDR-TB) at a private referral center in Korea. All patients with culture-confirmed pulmonary TB over a 2-yr period between July 2002 and June 2004 were prospectively included in this study. In total, 637 patients were included; 512 (80.4%) were new cases, and 125 (19.6%) were previously treated cases. Resistance to at least one first-line drug was identified in 11.7% of new cases and 41.6% of previously treated cases. MDR-TB was detected in 3.9% of new cases and 27.2% of previously treated cases. The proportion of extensively drug-resistant TB among MDR-TB patients was 16.7% (9/54). Factors associated with MDR-TB included age under 45 yr, previous TB treatment, and the presence of cavitation on chest radiography. Rates of first-line drug resistance are high, particularly in previously treated patients, in the private sector in Korea. This underscores the need for an improved control program, coupled with early diagnosis of MDR-TB, to reduce the spread and development of resistance

Fine-grained activity recognition using multimodal datasets

Thesis (Ph. D.)--University of Rochester. Dept. of Computer Science, 2016Until recently, the areas of perception, language and knowledge reasoning have been studied primarily in isolation. Activity recognition has been no exception; over the past years we have seen a variety of different models with the goal of accurately representing and inferring activities from sensor data. However, recent advances in sensor technology, computational capabilities and data storage have facilitated the collection of large-scale, multimodal datasets. We look at some of our efforts in collecting multimodal datasets in heavily instrumented spaces, which we call “smart task spaces.” Modes such as language and commonsense knowledge also have great potential for augmenting recognition in situations where sensor data is lacking. In particular, language can be used as a form of indirect labeling for activities when no labeled data exists. We present a system where new actions can be learned from text descriptions and multiple instances of video without explicit labeled data. We also present a general framework for complex event recognition that is well-suited for integrating information that varies in detail and granularity. We introduce the current state of the art in fine-grained activity recognition, and introduce a framework that integrates multiple modes of input into a single system. Our system uses Markov logic which encourages the combined use of probabilistic perceptual features with commonsense knowledge, represented using logic statements. Through our framework, we show that are able to effectively integrate natural language and commonsense knowledge in our activity models